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MULTI MODAL COMMUNICATIONS SYSTEM 

CROSS REFERENCE TO RELATED APPLICATION 

This application claims the benefit 0 f u «i Pr - 

' k.. < o/3,e,033, n,.d Aus „ s , 3 1 ,2oo, ApP " Ca "° n 

BACKGROUND OF THE INVENTION 

FIELD OP THE INVENTION 

10 

The preaeo, invention 8 e„er a I ly relate* to pr.ce Ss i ng of 
tciec „ ic (0 „ s belwe£n part(es . m ^ ^ ^ 

("It. Protocol, mu „i p , atform) „„,., for commnnical . oiis 
15 BACKGROUND OF THE INVENTION 

°" d b l d ' r "' •—«'•.««« i. which people «.„..„«.„ wil / 
ne another direofv, u5ing , he , ^ 

20 v„ vo.ee a 5 we .„ do , ta „„„.„ „,.,„,_ S " 

»->-«•»«'.- .ex, and ED8lish , , ite lMt(ut m J 

.° advanced ,ec„no,„ gy , on, cot» mu „ icati „ n snd „..,„ „. * y » 
— .now for ft™, of oo mm „ nic . li o 0 ,„., do „„, 

-he sp ea k er (»»., ra ,„ r) and „. „,,„,„, (oon , munica , 
-0 nee whatever .node and language suils the lndivjdua , 

per.on ee „ ex, mp ,e. the advent of re,a y services it, ,„. Unite, 
State, sorae parts „ WMM lodjy a]]ow ^ ^ 

eat g pcop „ , 0 communica|e oyar th< Te , ecomm 

«.f hard of heartng, spe „ h irapafrBd jndivjdllals ^ 
1. .Phones for e„ gag i„. . eon,n,u„ic a ,i„ n session over a telepnone 
a person „ a! . C o„ ys „, io „ a , vpl£c /»™ 
herd of hear,n g , spe ec„ .repaired individual „, ili2e Text T . |ep| , 



1 
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««h as Te lec „ rora „„ icatio „ Deyices ftr ^ • ■ 

«--..«,. ov„ lelepbona with bearing ans ; 
. . .„„„, ..... leleph0 „ s . The deaf person j£a 

Keyboard on the TDD or TTY a 
5 r. i 1 Y * a S P ec,a,1 y equipped device with a 

i: • ,o ( communica,e wi,h a -1 

-«f Person , yP es ,o hciring pCfSon on othcr 

*.». A t ypi c al TDD „ 3 , pha! , um „ ic leybojrd ; 

1"* ' Si " 8,e «* .... BAUDOT o 

signaling or both Th P r.^*, i 

'0 I. .his si ,a alio „ tt , deaf oe C ° m, " 0n de "° mi »°'<" 

P«y. The »..„., perso „ hea „ „ hl , js be . n m 

«Pr... h.tnself. Th.». moftU< .,.,„,.,„. 
protocol converter Th. , > ace ' 0r 

i 5 .n...i.. r ■ y ° pe,> " >r ac,s " in '" f °« ■» 
........ The „ Peral<) , actually raIays , nfornia 

, communical.on protocol to another. 

•; BRIEF SUMMARY OF THE INVENTION 

20 '" VieW ; f ' he tm ""* P«»". invention la dirae.ed , 0 . sysIem 
* —I., between partlas .„ . ,.,....„„,„„.„ 
BRIEF DESCRIPTION OF THE DRAWINGS 

-destood when read in conation with the aocon, P a„ yi „ a 
w hicll are ,„ cluded fcy way of _ mpie and » « 

'imitation with rpoarH t„ ,i, ■ 

wnn regard to the inventions wherein: 

p IG. 1. is a schematic block diat.1-*™ Af 

svstem f ^ , diagram of a commun.cations protocol 

system for duplex communications transactions. 



2 
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FIG. 2 is a schematic block diagram of a r*™™,. • 

* ^ or a communications protocol 
system for simplex communications transactions. 

FIG. 3 is a schematic bloc* diagram of system connectivity of the 
-> present invention. 

PIO. 4 i. . „,„«„ dlasram of and cmbodimcnt of 

system, mode translator, and , angoa8e trans|atoj of 
invention. 

10 

no. 5 .-. . S c he „ atic block dia8rlm of a fnr|her embod . meiit 

P....I ...... mada „ a „ s , alor and |a „ guage iransuior 

invention. ^ * 1,1 

PIO_ « ,. . lM diagr.n, of ,h. persona, oo mmunieati o„ s preferences 
of the present invention. 

FUNCTIONAL DESCRIPTION OF THE INVENTION 
» FIGS. 1.2 ,„„„„,., [tom . us „ , ransmission and reccpt . oo 

teferenee. . ....I-.^., (n, u . t i -pro tocol. ■.l«.p,.,f Qf «, porla| f „ 

••«•■'«■«'.« -™ . c a „er a „ d caIlca ,„ , telecomrnu „ icatio „ s 

*;"' Mh as *■'»■«*■*•». „,„,„„„,. muIlf . 

Platform porta, f „ ,„ mmanicatio „ s ca „ be ^ on ^ ^ 
com m „ n ,ca,io„ porta,. The p . rt .,. the „ .„. s „ va aj a 
center for everyone ,„ laave messagcs ^ ^ rf 

f.cs.mi,. a „d lran!mi[lsld „ y laavi „ 6 a ma . )bM ^ (o • 
P.t.r I. op.ra.ion. th . comnlul „ ca , ar or subscrjbcr wou|d ( ^ 

w.th „,s name and password. The pl a ,fo rm havi „ g , he 
30 communicMor's ptofiIc , w „ uId , hen know ^ 

COmmnnicion modes and other desired pararne.ers. He could ,he„ 
■nd.ca.e .he recipient's „ arae , phone number, o, IP address and 
•nd.ca.e ,he node of co mmu „ icati o„, or ,he desired or ,., 

protocol desired at the time of sign-on. 
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Referr.ng to FIGS. 1 and 2, there are several modes of the 
communications disclosed inching but no, limited to a video mode 
text (ASCII) mode, text mode with TTY/TDD, and a video mode. The 
5 transm.ss.on mediums for the modes ,ncludes many types of 
telecommunications systems and networks environments. For 
examp.e, a local, national, international telecommunications Public 
Sw.tched Telephone Network (PSTN) network, Internet a CATV 
network proving teiephony, a wireless/satellite telecommunications 
10 network, deluding cellular, or Personal Communication Services 
(PCS) networks or other suitable networks. Devices for 
accomplishing the modes of communications indudes telephones 
TTY/TDD, personal computers, pagers, or personal digital assistants. 

15 In a 2-wa y communication mode, or "conversational" mode in this 
case, referring to FIG. 1, in one cxamp.e of the portal in the text 
mode (ASCII or TTY)- t o-voice, a deaf perso* would sign onto the 
system, Vacate the phone number of the hearing person, and maybe 
h,sna me . The system automatically dials the phone number and bring 
up the trained voice recognition profile for that person (assuming the 
hear.ng person's number was pre-stored in the portal) and then 
communication takes place automatically. In this case, the portal 
■"eludes text-to-speech and speech-to-text hardware and software as 
known to one ordinary skill in, he art. The voice recognition engine 
25 then wouid take over and continually train itself to understand the 
speaker (hearing person). In doing so, it becomes a very enhanced 
speaker dependent profile and becomes more accurate over time. 

Referring to FIG. 1, we can replace a human relay operator with one 
30 that 1S totally automated/electronic, and use artificial intelligence 
equipment and technology. The deaf pers0 n keys his message in the 
usua. manner to a TRS, the protocol converter in this case could be a 
speech synthesizer which voices what the deaf person typed for the 
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hearing person to hear. Likewise, the hearing person talks back in to 
a vo JCe recognition eng.ne which then translates it into text for the 
deaf person to understand. The voice synthesizer could be further 
enhanced to match the deaf persons physical characteristics, 40 year 
old male, with a southern Texas accent to proper.y reflect hi s identity 
and background and also to create a sense of virtual identity. 

Instead of using a text, we can USe a video mode. In this case the 
relay operator, or protocol converter is a sign language interpreter 
10 The deaf person, instead of typing, uses sign language to 

communicate using a computer or a dedicated video device to the 
•interpreter who uses a similar device. The interpreter then relays the 
message in the usual manner using votce over a phone line or Internet 
.o the hearing person. The hearing person then voices back to the 
deaf pers0 n through the interpreter who signs to the deaf person what 
he hears the hearing person speak. Various enhancements can be 
made to the system. 

As the shown in FIG. 1, the protocol converter or interface is no, 
20 necessarily limited to the pure form of text or video or voice for that 
matte, It could handle voice on both ends, but then could function 
a* an automated language translator converting voice from one 
language to anther. In this case, the U„g„ age rcfers to linguislic 
spoken languages. For example, a hearing person can also Spea k in 
Enghsh to the protocol converter and the protocol converter would 
then synthesis his voice in French to a colleague in France. This 
has apphcation to a video relay systeni or TRS environment 
L.kew.sc for video modes, the protocol converter can convert from 

so r H AScn! SDN) 10 H323 ° P) Pr ° tOCOlS 8nd vice — Also ' '•«' 

30 (ASCII) to text (TTY-Baudot). 

Another example of the communication porta,, a hearing person can 
to speak into the protocol converter, which could create a sign 
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language avatar for expressing what the hearing person speaks into 
corresponding sign language. Conversely, a sign language 
recogn.tton engine can convert sign language into voice or text for 
that matter, This has application for a deaf blind person who cannot 
hear vo,ce, and can commun.cate with a deaf person who signs and 
-hen converted can go into an ASCII soft braiilcr for ttje deaf bHnd 
Person to understand sign langu.ge on the other end. Furthermore 
th.s has application ,o a v.deo relay system or TRS environment ' 

10 The devices to accom P , lsh all of this is based on an intelligent 

processor with software, in this case wou.d he a persona, computer 
The PC would always be .ocated at the point of the protoco, converter 
and sometimes a , the caller or the callee's site but not nece SSafi , y a « 
al, times. The PC may be a general-purpose computer, such as a 

15 num-computer, a high-speed computer workstation, or a l aptop 
computer configured accordingly. 

Hardware components of the computer system include a central 
processing unit, . system memory, and a system bus that couples 
20 vanous computer system components. Centra, processing unit may be 
one or more su.table general-purpose microprocessors used in a 
conventional computer. A storage device and associated computer- 
readable media provide nonvolatile storage of computer readme code 
^instructions for execution on the computer system. If desired a 
user may enter commands and information into computer system 
through an input dev,ce such aS a keyboard. In Edition, a monitor 
can be used for display. The co mputer Syslem can includfi ^ 
penpheral output devices, Such as a laser pnnter ^ 
systems are known to one of ordinary skill in the art. If desired 
30 computer system may oper.te in a networked environment using a 
network connection to one or more a destination clients such as a 
computer workstation or a network server. The networked 
environment may include a local area network (LAN), a wide area 

6 
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network (WAN), or a distributed network, snch as the Internet 
including the World Wide Web. Instead of the PC, the device used 
may range from a simple telephone, to a PDA (personal digital 

assistant). 

5 

All of this so far emphasizes a 2-way communication mode, or 
"conversational" mode in this case. As shown in FIG. 2, shifting to a 
1-way communication mode, which could be termed a "messaging" 
mode. Most of the same applications could be used in this context 
with a protocol converter like the 2-way mode, but extend its 
functionality to email, Video email, text email, voice email, facsimile 
email could be run through a protocol converter and then converted to 
a form that the recipient would like. The recipient could also have 
prc-selected profiles on the protocol. The recipient could receive 
messages in any form and determine which form he would like to read 
the message in. ..video, text or voice. For example, a sender could 
send a message in voice, have it run through a protocol converter 
which recognizes voice and creates a text message, or a sig n language 
avatar for the deaf person to see. One example of a web portal is 
shown in U.S. Patent No. 6,038,668 to Chipman which is herein 
expressly fully incorporated by reference for all purposes. 



15 



20 



In should be recognized that the web portal can include computerized 
gateway processors, which converts to the various protocols as 
25 disclosed. The web portal provides integration for the users. In 
addition, many modifications may be made to adapt a particular 
situation or material to the teachings of the invention without 
departing from the scope thereof. 



30 



There has thus been outlined, rather broadly, the more 
important features of the invention in order that the detailed 
description thereof that follows may be better understood, and in 
order that the present contribution to the art may be better 
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appreciated. There are additional features of the invention that will 
be described hereinafter and which will form the subject matter of the 
claims appended hereto. 

5 The objects of the invention, along with the various features of 

novelty which characterize the invention, are pointed out with 
particularity in the claims annexed to and forming a part of this 
disclosure. 



10 



As best illustrated in Figures 1 through 6, the multi modal 
communications system 10 generally comprises a portal system 20, a 
first communications mode 30, a second communications mode 35, a 
mode translator 40, and a language translator 50. 



15 



The portal system 20 provides high level system control and 
routing. The first communications mode 30 provides connectivity 
between a first user and the portal system 20. Similarly, the second 
communications mode 35 provides connectivity between a second user 
and the portal system 20 whereby the first user communications with 
20 the second user through the portal system 20. 

Each of the first 30 and second communications modes 35 are 
independently selectable from the group of communications modes 
consisting of Public Switched Telephone Network, CATV with 
25 telephony, wireless telecommunications network, satellite 

communications network, PCS, GSM, internet, World Wide Web, 
SONET, and Integrated Services Digital Network (ISDN). 

The portal system 20 in conjunction with the mode translator 40 
and the language translator 50 serves as a switching network and 
translator between the first 30 and second communication modes 35. 
The first communications mode 30 is associated with a 
communications means 32 selected from the group of communications 
means consisting of voice only, voice and video, video, text, or 

8 



30 



PAGE 14/41 * RCVD AT 31712006 4:42:33 PM [Eastern Standard Time] » SVR:USPTO-EFXRF-6/26 * DNIS:2738300 » CSID:2027366382 * DURATION (mm-ss):12-00 



FROM MCI Technoloj? Law Washington DC (TUE) 3. 7' 06 1 7 : 45/ST. 1 7 : 18/NO. 4261 173854 P 15 

FCT/US02/27797 

ASCII soft Br.il!.. Similarly, the second communications mode 35 is 
associated with a communications means 37 selected from the group 
of communications means consisting of voice only, voice and video, 
video, text, or ASCII soft Braille. 

5 

The mode translator 40 operationally interacts with the portal 
system 20. The mode translator 40 facilitates translation between the 
fust communication mode 30 and the second communication mode 35 
Typically, the first user uses a first language to communicate with the 
portal system 20, and the second user uses a second language to 
communicate with the porta! system 20. In some instances the first 
language and the second language may be the same. The messaging 
functions of this system 10 are just one example of a case in which 
the first and second languages may be the same. 



10 



15 



20 



25 



30 



The language translator 50 operationally interacts with the 
portal system 20 to translate between the first language and message 
data. The language translator 50 also operationally interacts with the 
portal system 20 to translate between the second language and 
message data. 

In a preferred embodiment, the language translator 50 further 
comprises a human interpreter 52. The portal system 20 includes an 
interpreter interface 22 to facilitate interaction between the human 
interpreter 52 and .he portal system 20. The human interpreter 52 may 
translate between a first spoken language and a second spoke,, 
language, a spoken language and a visual language, a first visual 
language and a second visual language, a spoken language and a data 
format, or a visual language and a data format. 

In a further embodiment the language translator 50 further 
comprises a speech recognition engine 54, a sign language 
recognition engine 56, a speech generator 58, a sign language 
generator 60, and a set of personal communications preferences 70. 

9 
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The speech recognition engine 54 may be operationally coupled 
to the portal system 20. The speech recognition engine 54 is used to 
facilitate translation between a spoken language and a visual 
5 language, a spoken language and a data format, a first spoken 
language and a second spoken language. The speech recognition 
engine 54 may supplement or replace the hearing function of a human 
interpreter 52. The personal communication preference 70 includes a 
spoken speech table 71 such that the speech recognition engine 54 is 
10 trainable for a specific user. 

The sign language recognition engine 56 may be operationally 
coupled to the portal system 20. The sign language recognition 
engine 56 facilitates translation between a visual language and a 

15 spoken language, a visual language and a data format, or a first visual 
language and a second visual language. The sign language 
recognition engine 56 may supplement or replace the visual functions 
of the human interpreter 52. The personal communication preference 
70 further includes a visual speech table 72 such that the sign 

20 language recognition engine 56 is trainable for a specific user. 

The speech generator 58 may also be operationally coupled to 
the portal system 20. The speech generator 58 facilitates translation 
between a first spoken language and a second spoken language, a 

25 spoken language and a visual language, or a spoken language and a 
data format. The personal communications preference 70 further 
includes a speech font 73 such that vocal qualities of the speech 
generator are modifiable by the user. The speech generator 58 may be 
used to augment or replace the vocal capabilities of a human 

30 interpreter 52. 

In still a further embodiment the speech font 73 includes 
parameters for specifying gender, age group, nationality, locality, and 
tone. 

10 
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The sign language generator 60 may be operationally coupled to 
the portal system 20. The sign language generator 60 facilitates 
translation between a first visual language and a second visual 
5 language, a visual language and a spoken language, or a visual 
language and a data format. 

In yet a further embodiment the sign language generator 60 
presents an avatar includes a torso, arms, hands, and a head. The 

10 avatar provides a visual representation of a visual language. The 

personal communications preference 70 may further include an avatar 
font 74 such that visual qualities of the sign language generator 60 
are modifiable by the user. The avatar font 74 may include 
parameters for specifying gender, age group, ethnicity, and general 

IS appearance. Factors for generalappearance may include, but are not 
necessarily limited to: hair color, hair length, skin tone, eye color, 
eye shape, mouth shape, and nose shape. 

With respect to the above description then, it is to be realized 
20 that the optimum dimensional relationships for the parts of the 
invention, to include variations in size, materials, shape, form, 
function and manner of operation, assembly and use, are deemed 
readily apparent and obvious to one skilled in the art, and all 
equivalent relationships to those illustrated in the drawings and 
25 described in the specification are intended to be encompassed by the 
present invention. 

Therefore, the foregoing is considered as illustrative only of the 
principles of the invention. Further, since numerous modifications 
30 and changes will readily occur to those skilled in the art, it is not 
desired to limit the invention to the exact construction and operation 
shown and described, and accordingly, all suitable modifications and 
equivalents may be resorted to, falling within the scope of the 
invention. ' 

11 
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CLAIMS 

We c 1 a i m : 

1. A multimodal network system for interpersonal 
5 communications comprising: 

a portal system for transmitting and receiving communications 
between various communications modes; 

a first communications channel providing connectivity between 
a first user and said portal system; 

a second communications channel providing connectivity 
between a second user and said portal system whereby said first user 
communicates with said second user through said portal system. 



10 



15 



2. The system of claim 1, wherein said portal system further 
comprises a user one switching subsystem for selecting a first 
communicates channel from a plurality of communication modes, 
said portal system then routing communication to said second 
compunctions ch a „ nc , whcreb y connectivity between said first user 
and said second user is achieved. 



20 



3. The systcm of claiml, wherein said portal system further 
compnses a user two switching subsystem for selecting a second 
communications channel from a plurality of communication modes, 
said portal system then routing communication to said first 
25 communications channel whereby connectivity between sa,d second 
user and said first user is achieved. 

4. The system of claim 1, further comprising a switching 
subsystem for selecting a first communications channel from a first 
30 plurality of communications modes, said switching system selecting a 
second communications channel from a second plurality of 
communication modes, said portal system then routing communication 
between said first user and said second user, said switching 
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subsystem being a mode translator between said first and second 
communications channels. 

5. The system of claim 4, further comprising: 
5 said first communications channel being selected from the group 

of communications modes consisting of Public Switched Telephone 
Network, CATV with telephony, wireless telecommunications 
network, satellite communications network, PCS, GSM, Internet, 
World Wide Web, SONET, H320 video-conferencing (ISDN), and 
10 H323 video-conferencing (IP); 

said second communications channel being selected from the 
group of communications modes consisting of Public Switched 
Telephone Network, CATV with telephony, wireless 

telecommunications network, satellite communications network, PCS, 
15 GSM, Internet, World Wide Web, SONET, H320 video-conferencing 
(ISDN), and H323 video-conferencing (IP); 

said first communications channel being selected independently 
from selection of said second communications channel. 

20 6. A multi-modal network system for interpersonal 

communications comprising: 

a portal system for transmitting and receiving communications 
between various communications modes; 

a first communications channel providing connectivity between 
25 a first user and said portal system, said first communications channel 
being selected from the group of communications modes consisting of 
Public Switched Telephone Network, CATV with telephony, wireless 
telecommunications network, satellite communications network, PCS, 
GSM, Internet, World Wide Web, SONET, H320 video-conferencing 
30 (ISDN), and H323 video-conferencing (IP); 

a second communications channel providing connectivity 
between a second user and said portal system whereby said first user 
communications with said second user through said portal system, 

13 
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said second communications channe , faeing se|ected ^ ^ ^ ^ 
communications modes consisting of Public Switched Telephone 
Network, CATV with telephony, wireless telecommunications 
network, satellite communications network. PCS, GSM, Internet 
5 World Wide Web, SONET, H320 video-conferencing (ISDN), and 
H323 video-conferencing (IP); 

said first communications channel being selected independently 
from selection of said second communications channel. 



10 



15 



20 



7. The system of claim 6, further comprising: 
a data handling subsystem for identifying a first communication 
means being uti,i Z ed over said first communications channel and a 
second communication means being utilized over said second 
communications channel; 

said first and second communications means being selectable 
from a group of communications means consisting of voice 
facsimile, data, ASCII text, TTY-b.udot. video or ASCII soft brai, 
*a,d first communication means being selected independently from 
selection of said second communication means; 

said first communications means being selectable to 
accommodate personal communications preferences of the first user; 

said second communications means being selectable to 
accommodate personal communications preferences of the second 



user. 



25 



30 



8. The system of claim 7, further comprising a speech 
recognition engine operationally coupled to said portal system, said 
speech recognition engine facilitating translation of spoken speech 
into message data, said message data being routable via said portal 
system through a selected combination of communicat.ons channel, 
communications mode, and communications means. 



14 
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9. The system of claim 8, wherein said personal communications 
preferences further includes a spoken speech table such that said 
speech recognition engine being trainable for specific users based 
upon said spoke speech table. 

5 

10. The system of claim 7, further comprising a speech 
generation engine such that message data may be converted to a 
spoken language, said spoken language being routable via a selected 
combination of communications channel, communications mode, and 

10 communications means. 

11. The system of claim 10, -wherein said personal 
communications preferences further includes a generated speech table 
such that said spoken language being modifiable based on said 
generated speech tabic. 



15 



20 



12. The system of claim 1 1, wherein said generated speech table 
further includes a gender selection such that the vocal qualities of 
said spoken language reflect the gender of the user. 

13. The system of claim 11, wherein said generated speech table 
further includes an age group selection such that the vocal qualities 
of said spoken language reflect the age of the user. 

14. The system of claim 11, wherein said generated speech table 
25 further comprises a nationality selection such that the vocal qualities 

of said spoken language reflect the nationality of the user. 

15. The system of claim 11, wherein $aid generated speech table 

further includes a geographic region selection such that the vocal 

30 qualities of said spoken language reflect a geographic region selected 
by the user. 



15 
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16. The system of claim 11, wherein said generated speech table 
further includes a tone selection such that the vocal qualities of said 
spoken language are modifiable to a tone selected by the user. 

5 17. The system of claim 11, wherein said generated speech table 

further comprises: 

a gender selection such that the vocal qualities of said spoken 
language reflect the gender of the user; 

an age group selection such that the vocal qualities of said 
spoken language reflect the age of the user; 

a nationality selection such that the vocal qualities of said 
spoken language reflect the nationality of the user; 

a geographic region selection such that the vocal qualities of 
said spoken language reflect a geographic region selected by the user; 

a tone selection such that the vocal qualities of said spoken 
language are modifiable to a tone selected by the user. 



10 



15 



20 



18. The system of claim 10, further comprising a sign language 
interpreter for reading sign language and translating said sign 
language to message data using a message format, said sign language 
interpreter being supplied with a video signal via said portal system. 

19. The system of claim 18, wherein said sign language 
interpreter being a human being, said portal system routing a visual 

25 representation of a video signal from a User , said human being 
providing real time translation of sign language into a message 
format. 



30 



20. The system of claim 18 wherein said sign language 
interpreter being a sign language recognition engine, said sign 
language recognit.on eng in e converting a visual representation of 
sign language into message data, said sign language recognition 
engine being operationally coupled to said portal system. 



16 
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2 1 . The fiystem of claim I 8, further comprising a personal 
communications preferences including a visual speech table such that 
"id sign language recogmtion engine being trainable for specify 
users. 

5 

22. The system of c Iaim 7 , further comprising a sign language 
generator for converting message data to sign language, said portal 
system providing said message data to said sign language generator. 



10 



15 



20 



23. The system of claim 22, wherein said sign language 
generator being a human being, said portal system routing a message 
data to said human be,ng providing real time translation of said 
message data into sign language. 

24. The system of claim 22, wherein said sign language 
generator being an avatar, said avatar providing an automated v.sual 
representation of sign language, said avatar being operationally 
coupled to said portal system such that Sa id message data provides 
and input for said avatar. 

25. The system of claim 24 further comprising a personal 
communication, preference including a visual speech generation table 
such that a form of sa ,d avatar is modifiable in accordance with 
preferences of the user. 

26. The system of claim 25, wherein said visual speech 
generation table further comprises a gender selection such that the 
v.sual quaJities of the avatar correspond with the gender of the user. 

27. The system of claim 25, wherein said visual speech 
generation tabic further comprises an age selection such that the 
visual qual.ties of the avatar correspond with the age of the user. 

28. the system of claim 25, wherein said visual speech 

35 generation table further comprises a ethnic background selection Suc „ 

17 
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thai the visual qualities of the avatar correspond with the ethnic 
background of the user. 

29. The system of claim 25, wherein said visual speech 
5 generation tabic further comprises a general appearance selection 
such that the visual qualities of the avatar correspond with a general 
appearance selected by the user. 



10 



30. The system of claim 7, further comprising: 

a speech recognition engine operationally coupled to said portal 

system, sa id speech recognition engine fac.litating translation of 

spoken speech into message data, said message data being routable 

via said portal system through a selected combination of 

communications channel, communications mode, and communications 
15 means; 

said personal communications preferences further includes a 
spoken speech table such that said speech recognition engine being 
trainable for specific users based upon said spoke speech table; 
a speech generation engine such that message data may be 
20 converted to a spoken language, said spoken language being routable 
via a selected combination of communications channel, 
communications mode, and communications means; 

said personal communications preferences further includes a 
generated speech table such that said spoken language being 
25 modifiable based on said generated speech table; 

wherein said generated speech table further comprises: 

a gender selection such that the vocal qualities of said spoken 

language reflect the gender of the user; 
an age group selection such that the vocal qualities of said 
30 spoken language reflect the age of the user; 

a nationality se lect,on such that the vocal qualities of said 
spoken language reflect the nationality of the user; 



IS 
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a geographic region selection such that the vocal qualities of 
said spoken language reflect a geographic region selected 
by the user; 

a tone selection such that the vocal qualities of said spoken 
5 language are modifiable to a tone selected by the user; and 

a sign language interpreter for reading sign language and 
translating said sign language to message data using a message 
format, said sign language interpreter being supplied with a video 
signal via said portal system. 



10 



31. The system of claim 30, wherein said sign language 
interpreter being a human being, said portal system routing a visual 
representation of a video signal from a user, said human being 
providing real time translation of sign language into a message 



15 format 



20 



25 



30 



32. The system of claim 30, wherein said sign language 
interpreter being a sign language recognition engine, said sign 
language recognition engine converting a visual representation of 
sign language into message data, said sign language recognition 
engine being operationally coupled to said portal system; 

said personal communications preferences including a visual 
speech table such that said sign language recognition engine being 
trainable for specific users; and 

a sign language generator for converting message data to sign 
language, said portal system providing said message data to said sign 
language generator. 

33. The system of claim 32, wherein said sign language 
generator being a human being, sa ld portal system routing a message 
data to sa.d human being providing real time translation of said 
message data into sign language. 



19 
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The sys , effl of claim 32> where . n ss . d s . go iu ■ 

•«.r.l.r being an avatar, said avalar providjn6 an 
'«P».«. Mi .. of sig „ lanBuagCi said ava(ar bajng ^ 
e..pM ,o said porta, syslem such ,„„ said mejsage ^ 
^ and input for said avatar; 

said personal communications preference including a visual 
speech generation table such that a f fl rm . 

" ,nat a form of s »>d avatar is modifiable 
m accordance with preferences of .he user; 

wherein said visual speecJl generatjo ; ^ ^ 
a gender selection such that the visual qualities of the avatar 

correspond with the gender of the user 
an age selection such that the visual qualities of lhe ava(ar 

correspond with the age of the user; 
an ethnic background selection such that the visua. qua ,ities of 
the avatar correspond with the ethnic background of the 
user; and 

a general appearance Section such that the visual qualities of 
the avatar correspond with a genera] appearance se.ectcd 
by the user. 

20 

35. The syst em of claim 7, further comprising a spoken 
anguage translator for converting a first spoken Janguage to a second 
spoken , ang uage such that said first nnd second users do not need to 
use that same spoken language. 

25 

36. The sysi e m of claim 7, further comprising- 

» — ging subsystem f or routing message data from a first 
-er to a second user in a delayed ^ sajd n 

30 IT ° Pe ; 3(i0na,,y t0 ^rtal systen, for receiving said 

3U message data; 

•""..i.J profll. for ,„...,„„., . me|hod „ f d>| 
delayed message. 
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37. The system of claim 36 wherein said method of delivery 
being selected from a group of delivery methods consisting of voice 
mail, electronic mail, electronic paging, web-site access, and 
facsimile. 

5 

38. The system of claim 7, further comprising a visual 
language translator for converting a first visual language to a second 
visual language such that said first and second users do not need to 
use the same visual language. 

10 

39. The system of claim 7, further comprising: 

a human interpreter for converting a spoken language to 
message data and converting message data to a spoken language; 

a human interpreter interface operationally coupled to said 
portal system, said human interpreter interface having a data input 
means and a data output means facilitating interaction between said 
human interpreter and said portal system. 

40. A multi-modal communications system for facilitating 
20 multiple translations comprising: 

a portal system providing high level system control and routing; 
a first communications mode providing connectivity between a 
first user and said portal system; 

a second communications mode providing connectivity between 
25 a second user and said portal system whereby said first user 

communications with said second user through said portal system; 

said first and second communications modes being 
independently selectable from the group of communications modes 
consisting of Public Switched Telephone Network, CATV with 
30 telephony, wireless telecommunications network, satellite 

communications network, PCS, GSM, Internet, World Wide Web, 
SONET, and Integrated Services Digital Network (ISDN); 
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..id porta, system 5arvi „, as . Slvi|chjng network ir<a 

f,rsl a " d "'oni communication modes; 
said firs, communicates mode being associated with a 
oommunicatrons „„„ n)nM from eroup ^ 

""r ' "r 5 "" 8 ° f """ °" ,y ' " d '««. «r 

ASCII soft brail; 

said second communications mode being associated with a 
communications means selected from ,„e gr00p communications 
means consisting of vo ice only , VQjcc ltJ yjdeo ^ 

10 ASdl soft brail; 

. mode transla.or operationally interacting with said ports, 
system, said mode „ a „ sla ,or facilitating transition between said 
fust —icatio, mode end said second communication mode- 
sa,d fir., user using . firsl ,.,,„„.„. ,„ aonlmunica|e w 
15 portal system; 

said second „„ using , second Janguage tQ conimun . cate 
sard porial system; 

a language translator operationally interacting with said porta| 
system to tranalate between fir,, inguage and message data, said 
language lr a Dslator operational interacting with said portal system 
to translate between said second language and message data 

4, The sys ,em of Cairn 40, where.n said language translator 
further comprises a human in.erpreter, said porta, system baving an 
■nterpreicr .nrerfaee to facilitate interaction between said buman 
.nt.rpr.ter and said porta, system, sai d human interpreter ,r.„s,ari„g 
....... a f,ra, spolcen ,a„ E uage and a second spoken , a „ B „ aEe , sald 

omen rn.crprerer transiting between , spoken , a „guage and a vi s „ a , 
language, said human i„, C rpr.,cr translaling , fjm 

30 language and a second visua, ,a„g uage , said 

,rans,a,i„ 8 between a spoken ,.„guage and a data forma,, said human 
.".crprcc, .ran.,.,,,, belween , visua , ^ ^ ^ 

22 
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42. The system of claim 40, wherein said language translator 
further comprises a speech recognition engine operationally coupled 
to said portal system, said speech recognition engine facilitating 
translation between a spoken language and a visual language, said 
5 speech recognition engine facilitating translation between a spoken 
language and a data format, said speech recognition engine facilitates 
translation between a first spoken language and a second spoken 
language. 

10 43. The system of claim 42, further comprising a personal 

communication preference including a spoken speech table such that 
said speech recognition engine is trainable for a specific user. 

44. The system of claim 40, wherein said language translator 
15 further comprises a sign language recognition engine operationally 
coupled to said portal system, said sign language recognition engine 
facilitating translation between a visual language and a spoken 
language, said sign language recognition engine facilitating 
translation between a visual language and a data format, said sign 
language recognition engine facilitating translation between a first 
visual language and a second visual language. 



20 



45. The system of claim 44, further comprising a personal 
communication preference including a visual speech table such that 

25 said sign language recognition engine is trainable for a specific user, 

46. The system of claim 40, wherein said language translator 
further comprises a speech generator operationally coupled to said 
portal system, said speech generator facilitating translation between a 
first spoken language and a second spoken language, said speech 
generator facilitating translation between a spoken language and a 
visual language, said speech generator facilitating translation 
between a spoken language and a data format. 



30 
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47. The system of claim 46, further comprising a personal 
communications preference including a speech font such that vocal 
qualities of said speech generator are modifiable by the user. 



5 



48. The system of claim 47 wherein said speech font includes 
parameters for specifying gender, age group, nationality, locality, and 



tone. 



10 



20 



25 



30 



49. The system of claim 40, wherein said language translator 
further comprises a sign language generator, said sign language 
generator being operationally coupled to said portal system, said sign 
language generator facilitating translation between a first visual 
language and a second visual language, said sign language generator 
facilitating translation between a visual language and a spoken 
15 language, said sign language generator facilitating translation 
between a visual language and a data format. 

50. The system of claim 49, where said sign language generator 
presents an avatar having a torso, arms, hands, and a head, said 
avatar providing a visual representation of a visual language. 

51. The system of claim 50, further comprising a personal 
communications preference including an avatar font such that visual 
qualities of said sign language generator are modifiable by the user. 

52. The system of claim 5 1 wherein said avatar font includes 
parameters for specifying gender, age group, ethnicity, and general 
appearance. 

53. The system of claim 40, wherein said language translator 
further comprises; 

a speech recognition engine operationally coupled to said portal 
system, said speech recognition engine facilitating translation 
between a spoken language and a visual language, said speech 

24 
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rr d "; o v n8iDe facima,in8 tm °* *«-» • »*« ■«..«. 

, ' da ' a f ° rma '- Sa ' d '«-«ni.io. engine f.ci. 

. *.„■„... kel „« 0 . firs , spok „ , jneoage a 8econj 

5 , ah . 3 C ° mmU ° i, " ti °° »" f ""« 1-cI.di., . spoken speech 

I. ...» .h., aa.d S paee„ reeoenitioI1 engine is lwl » 

specific user; 

. sigu ,an guase racog,,,;,,,, engine ,, perationil 

■0 , I.', 7' SiS " la ° SU " ge r "° Sni,i0 '' •»«"• *»'««'U 
Z. , reC ° 8 " i "' 0 " enei ° = faC " i,2,i ° 8 a 

; ; t and a da,a forma '- ai8n '■-«»«• •»•*■«.. 

second vi sila | language; "gaage and a 

15 »id parson,, co mmu „ ieaIi(> „ prafarence further indudaa a 

::zt " b, "° ch aaid s "" ■■-•«• '-«■«<•. ...... .-. 

trainable for a specific user; 

• «P..ch generator operaliooally coupled ,„ 5aid p„ rtal 5ystanl 
».d speech genaralor raciHtatiitg , ranslation ba(ween / £ 
» anguage aad a aacoad S po k a„ , ang „ asa , taid sp „ ch ..^J"" 
facilitating ,ra nslalion betwee „ . ^ J « 

"gnage. said apaach ganara.or r.ciUt.tiug bc , w „„ . 

spoken language and a data format; 

25 sn= Pe ' S °" a ' C ° mm '"' i "' i ^ further iodudaa a 

lod r ' ha ' V ° Cal ,UaIi " ea " •»•«■'« «. 

modifiable hy the user; 

wherein said apeech f„ n , i nc ,„ des p!ITaweUrs 
gender, age group, nationality. ,„ c .,i, y> , Dd ,„ ne . 

W operation.,,, coupled to sa id porta, ,., 4 s i s „ Unga ^ 

•"""r faC '■•"« »-e,„ a first visua, language .„< 

a second v lsuaI , a „ 8uase . sajd s , gn 
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translation between a visual ,anguage and a spoken language, said 
s.gn l a „g uage generator facilitating translation between a visual 
language and a data format; 

wherein said sign language generator presents an avatar having 
5 a torso, arms, hands, and a head, said avatar providing a vis Ua ] 
representation of a visual language; 

said personal communications preference further includes an 
avatar font such that visual qualities of said sign language generator 
are modifiable by the user; and 



10 



15 



-id avatar font includes parameters for specifying gender, age 
group, ethnicity, and general appearance. 

54. The system of cUim 53j whefein sa . d portaJ systera 

co mprIses a storage means for storing Sa id message data for delivery 
to a second user at a later time. 
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